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OPTIMAL CRYSTALLIZATION 
PARAMETER DETERMINATION PROCESS 

RELATED APPLICATION 
This application claims priority of United States Provisional Patent 
Application Serial No. 60/412,337 filed September 20, 2002, which is 
incorporated herein by reference. 

FIELD OF THE INVENTION 
The present invention relates in general to determining crystallization 
parameters for a sample, and in particular to the use of a self-learning 
crystallization optimization function for determining crystallization parameters 
from a large set of possible permutations. 

BACKGROUND OF THE FNVENTION 
Typically, a crystal grower attempts to crystallize as sample 
commercially available screens such as those available from Hampton 
Research, Emerald Biosystems, and Jena Bioscience. In the absence of a 
suitable crystal being grown or positive result from a screen, the crystal grower 
will try another screen, and so on until they exhaust the available screens. The 
vast majority of proteins (80-90%) never yield suitable crystals for structure 
determination via x-ray diffraction (Lamzin, V.S. and Perrakis, A. Current 
state of automated crystallographic data analysis. Nature Structural Biology, 
Structural Genomics Supplement, 2000, 978-981). If the crystal grower is 
lucky and obtains a crystal, the crystal often is small and plagued with defects, 
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thereby rendering the crystal unsuitable for x-ray diffraction. The crystal 
grower then attempts to create a set of crystallization experiments around the 
condition that yielded the small imperfect crystal in order to grow large, defect- 
free crystals by a process called optimization. Usually, a linear grid screen that 
5 varies 1 or 2 variables such as pH or precipitating agent is used around the 
small crystal growth parameter hit. The optimization conditions often are 
laboriously hand-prepared. Typically, only positive results are recorded, with 
the vast majority of negative crystallization outcomes being discarded. The 
negative crystallization outcomes are usually physically classified in groups 
10 such as clear drop, phase change, precipitate, and spherulettes. The few 
proteins that ultimately yield crystals may take months or even years to 
crystallize. 

Optimization of protein crystal growth have been performed using 

multivariate designs such as central composite, Box-Behnken and full factorial 
15 and incomplete factorial. These designs systematically evaluate several 

variables around a central point or within a range (Box, G.E.P. and Hunter, J.S. 

Ann. Math Statist. 1957, 28:195; Box, G.E.P., and Behnken, D.W. 

Technometrics 1960, 2:455; Box, G.E.P., Hunter, W.G, and Hunter, J.S. 

"Statistics for Experimenters." Wiley Interscience, New York, 1978; Carter Jr., 
20 C.W., and Carter, C. W. Protein crystallization using incomplete factorial 

experiments. J. Biol. Chem. 1979, 254:12219-12223; Carter Jr., C.W. 

Response surface methods for optimizing and improving reproducibility of 

crystal growth. Methods in Enzymology 1997, 276: 74-99; and Shaw Stewart, 
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P.D., and Baldock, P.F.M. Practical experimental design techniques for 
automatic and manual protein crystallization. J. Crys. Growth 1999, 
196:665-673). 

A comprehensive model for protein crystallization does not exist. The 
optimization methods identify user-defined variables in a systematic procedure 
to determine those variables most important for the particular protein sample to 
crystallize. There usually are four variables that are common to all protein 
crystallization experiments: protein and precipitant concentration, pH, and 
temperature. However, often there are more variables than currently can be 
evaluated. If possible, it is wise to select a variable that has a linearly 
independent effect on protein crystal growth (Box, G.E.P., Hunter, W.G, and 
Hunter, J.S. "Statistics for Experimenters." Wiley Interscience, New York, 
1978). In order to model the protein crystallization data the results are scored. 
Hence, the experience of a crystal grower plays an important role in the 
subjective assessment of data and ultimately the successful crystallization of a 
protein. Thus, there exists a need for a process for objectively screening a 
multi-dimensional parameter space incorporating all outcomes to rapidly 
identify optimal crystallization parameters. 

SUMMARY OF THE INVENTION 
A crystallization parameter optimization process includes the steps of 
selecting multiple, physical characterization input variables to define a total 
crystallization experiment permutation number for a crystallant. A series of 
crystallization experimental samples are performed with the total number of 
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samples being less than the permutation number. A predictive crystallization 
function if trained through analysis of the crystallization experimental samples 
that have been run. An optimal physical crystallization parameter is 
determined based on the predictive crystallization function. 

5 A crystallization parameter optimization process also includes the step 

selecting multiple physical characterization input variables for a known 
crystallant to define a total crystallization experiment permeation number. 
Multiple crystallization experimental samples are performed on the known 
crystallant. A predictive crystallization function is trained through analysis of 

10 the multiple crystallization experimental samples. The predictive 
crystallization function is used to determine optimal physical crystallization 
parameters for the known crystallant. The optimal physical crystallization 
parameters and a physical property of the known crystallant are stored in a 
classification system. A comparison between an unknown crystallization 

15 sample to the classification of the known crystallant is used to optimize 
crystallization parameters for the unknown crystallization sample. In 
particular, protein crystals are grown through the use of crystallization 
parameter optimization processes as detailed herein. 

A neural network is readily trained through analysis of the multiple 

20 crystallization experimental samples to predict optimal crystallization 
conditions for a protein. 

A system for crystallization parameter optimization includes a database 
containing multiple input variables, each of which has a value range. The 
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system also includes an incomplete factorial screen program including a 
trainable predictive crystallization function. A computer is provided that is 
capable of executing the incomplete factorial screen program to determine an 
optimal crystallization parameter. In addition, the system includes a 
5 manufacturing execution system for automatic acquisition of data from each of 
the crystallization experimental samples, as well as the analysis and archiving 
of data from the incomplete factorial screen program. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a schematic depiction of a system for carrying out the 
10 present invention; 

Figure 2 is a schematic illustrating a trained neural network according 
to the present invention for the exemplary lactoglobulin protein crystallization 
test; 

Figure 3 is a graph of neural network training incomplete factorial 
15 experiments as a function of score for the network based on the scoring scheme 
of Table 3 depicted in Figure 2, where actual values are depicted as a solid line 
and network predicted values are depicted as a hashed line; 

Figure 4 is a graph of neural network crystallization predicted scores 
derived for experiments unseen by the trained network of Figure 3 where 
20 predicted scores are depicted as hashed lines, as compared to actual measured 
scores depicted as solid lines; 
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Figure 5 is a photograph illustrating the actual physical crystallization 
outcomes of the two predicted crystallization conditions for experiments 322 
and 340 of the lactoglobin crystallization of Figure 4; 

Figure 6 is a graph of neural network training incomplete factorial 
5 experiments as a function of score for an unknown protein based on a binary 
scoring scheme, where actual values are depicted as a solid line and network 
predicted values are depicted as a hashed line; 

Figure 7 is a graph of neural network crystallization predicted scores 
derived for the unknown protein experiments unseen by the trained network of 
10 Figure 6 where predicted scores are depicted as hashed lines, as compared to 
actual measured scores depicted as solid lines; 

Figure 8 is a photograph illustrating the actual physical crystallization 
outcomes of the predicted crystallization condition for experiments 350 of the 
unknown protein crystallization of Figure 7; 
15 Figure 9 is a graph of a neural network training incomplete factorial 

experiments as a function of score for the network based on the scoring scheme 
of Table 5, where actual values are depicted as a solid line and network 
predicted values are depicted as a hashed line; 

Figure 10 is a graph of a neural network crystallization predicted scores 
20 derived from experiments unseen by the trained network of Figure 9 where 
predicted scores are depicted as hashed lines, as compared to actual measured 
scores depicted as solid lines; 
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Figure 1 1 is a bar graph illustrating the relative importance of various 
crystallization input values as determined for Delta 8-10B protein derived from 
Figs. 9 and 10; 

Figure 12 is a graph of neural network training incomplete factorial 
experiments as a function of score for the network based on the scoring scheme 
of Table 8 where actual values are depicted as a solid line and network 
predicted values are depicted as a hashed line; 

Figure 13 is a graph of neural network crystallization predicted scores 
derived from experiments unseen by the trained network of Figure 12 where 
predicted scores are depicted as hashed lines, as compared to actual measured 
scores depicted as solid lines; and 

Figure 14 is a bar graph depicting the relative importance of input 
variables for the crystallization experiments depicted in Figs. 12 and 13. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
The present invention has utility as a process for optimizing 
crystallization conditions for a variety of substances. The present invention 
includes self-learning programs based upon neural networks and/or smart 
algorithms that divine optimal crystallization conditions. The operation of 
these programs is preferably combined with a high-throughput automated 
screen preparation liquid dispenser that physically creates the customized 
conditions for each sample. A neural network and/or a smart algorithm 
according to the present invention provides a novel understanding of the highly 
non-linear crystallization process, thereby reducing the number of required 
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experiments, and needed quantities of experimental samples. With the present 
invention operating to automatically prepare the screening experiments, human 
error is also eliminated. The reduction in the time required to create 
crystallization recipes speed the structure-based drug design cycle or other 
crystallization related activities. 

While the present invention is described with respect to protein 
crystallization, it is appreciated that the present invention is operative in the 
optimization of crystallization conditions for a variety of potential crystallant 
substances illustratively including organic molecules, organometallic 
molecules, inorganic molecules, nanocrystals, and viruses. An inventive 
crystallization process speeds structure-based drug design by expediting the 
crystallization of protein crystals, as well as by revealing the crystallization 
process itself, thus allowing investigation of variables important for 
crystallization. The innovative crystallization functions are based on neural 
networks that use every outcome in the training process, so even "clear drop", 
"phase change" and "precipitate" crystallization experiment results contribute 
information to the self-learning functions. 

The components of a preferred automated system according to the 
present invention are shown in Figure 1 and include a software interface 2 that 
allows for crystallization screens to be designed using an incomplete factorial 
method for sampling the user defined variable space, and physically created by 
the hardware component, such as a commercial available liquid dispenser 3 
such as a Microlab MPH 96 with 96 probe heads (Hamilton Instruments, Reno, 
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NV). The liquid dispenser 3 will automatically pipette the incomplete factorial 
designed screen into user selectable sample carrier tray plates 4 in volumes of 
up to several milliliters. An additional dispenser 5 pipettes a crystallant 
sample, such as a protein into the tray plates containing the screen components 
or alternatively, the protein is premixed with the screen with the liquid 
dispenser 3. The incomplete factorial systematically samples the entire 
experimental space. For example, a ten variable experimental space 
represented by 47 components has 328,050 possible experimental 
permutations. This crystallization parameter space can be statistically sampled 
with 300-500 experiments. The ability to automatically design and physically 
create incomplete factorial screens for use with any crystallization dispenser is 
complemented by the predictive crystallization functions. After the protein 
crystallization images from a crystal imaging system are screened with the 
initial incomplete factorial screen, every outcome is entered into the inventive 
system software either manually or automatically through an XML interface 
such as CrystalScore™ (Diversified Scientific, Inc., Birmingham, AL), to 
provide the automatic image acquisition, analysis, and archiving solution for 
protein crystallization experiments. 

Preferably, a camera 7 utilized in an inventive crystal imaging system 6 
has a digital output signal, such as that collected by a charge coupled device 
equipped with a frame grabber, although it is appreciated that an analog 
specimen image is readily operative herein using conventional image 
manipulation techniques. 
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A crystal examined according to the present invention is detailed herein 
as occurring in a crystallization tray plate 4. It is appreciated herein that other 
crystallization media well known to the art are also operative herein. Suitable 
crystallization media include conventional glass and plastic slides, plates and 
tubes, as well as silicon based chips and arrays, or other suitable platforms that 
allow for controlled evaporation. 

In an alternate embodiment, the crystallization media is held in a 
stationary position and an inventive camera moves relative thereto. An 
indexing system of markings relative to a crystallization well or other 
conventional alignment schemes are utilized to assure proper orientation and 
illumination relative to the well. The position of a camera relative to a 
crystallization well is precisely controlled using a track or arm interfaced by 
way of a stepper motor or the like. 

It is appreciated that the inventive system is operative in not only a 
conventional camera placed over a specimen arrangement, but also in an 
inverted geometry or a side-by-side arrangement therebetween. 

In a preferred embodiment, a robotic handler 9 is utilized to manipulate 
crystallization media such as a tray plate 4 into a spatial area in which the 
imaging system 7 is capable of image acquisition. The crystallization 
media-grasping portion of a robotic handler is appreciated to be dependent 
upon the dimensions and grasping protuberances thereof. In a particular 
embodiment, conventional crystallization tray plates 4 are manipulated by a 
robotic handler 9 so as to be placed within the spatial acquisition area of the 
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camera for imaging and thereafter removed. Crystallization media in this way 
can be sequentially examined with minimal human intervention. In a preferred 
embodiment, a robotic handler 9, if present, a movable camera, or movable tray 
is under feedback control of a camera-centering algorithm of imaging software 
-H- relative to a preselected crystallization site. The algorithm operates on an 
initial camera image to calculate the center of and focus of, for example, a 
crystallization well. The deviation between the center of the crystallization 
well and the camera image is transmitted to an appropriate hardware translation 
stepper motor (not shown) in order to align the center of the crystallization well 
with the center of the imaging field. Camera focus is preferably determined 
through collection of a movie collected as a function of focus with an autofocus 
algorithm determining image collection focus. Alternatively, a manual 
override of the focusing aspect or any other function defined herein as 
automatically performed by an algorithm run by a processing unit occurs at the 
option of an operator. Optionally, the algorithm 44- also serves to identify the 
liquid drop from which crystallization is hoped to occur. The drop size is used 
to compute factors relevant to crystallization analysis illustratively including 
drop volume, evaporation rate, deviation of crystallization nucleus from well 
center, and crystallization solution turbidity. Camera image data illustratively 
including turbidity, straightness of crystal edges, crystal defect assessment, 
fractures in the crystal, crystal size and the like are combined to bin a 
crystallization outcome to one of a predetermined number of states. 
Information classified according to the preselected number of states is available 
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for subsequent analysis, refinement of classification states, and evaluation of 
crystallization scoring formulas. A crystallization scoring system automatically 
evaluates a result signal representative of a specimen condition into one of 
multiple outcomes for a specimen drop crystallization experiment. While it is 

5 appreciated that any number of schemes are operative herewith, in a preferred 
embodiment a crystallization experiment outcome is binned into one of nine 
states including clear drop, phase separation, precipitate, microcrystal/ 
precipitate, rosette/spherulite, needle, plate, small three-dimensional crystal and 
large three-dimensional crystal. In a preferred embodiment, a crystallization 

10 experiment is automatically scored by the inventive system. Alternatively, an 
operator manually enters a numeric code associated with each of a preselected 
number of crystallization experiment outcomes. 

An inventive computer controlled crystal imaging software system 17 
preferably includes scheduling software for periodic crystal image collection 

15 for particular crystallization experiments. Scheduling software is appreciated 
to further serve the function of obtaining information with respect to 
evaporation and crystal growth rates. In order to facilitate image collection for 
the large number of specimens associated with a typical crystallization study, 
an inventive system optionally includes a barcode associated with a 

20 crystallization medium. A barcode scanner associated with a robotic handler, if 
present, or a specimen stage assures proper specimen identification and 
operator data entry. Additionally, a barcode system scheduling of successive 
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image collection representative of a particular specimen is accomplished 
without operator input. 

In order to ensure even illumination of the crystal specimen during the 
image acquisition by the imaging system 7, preferably a fiber optic lighting 
system 3© 18 is utilized as a back light under the tray plate 5 4. In one 
embodiment, the computer 13 running the imaging software ±± can control the 
intensity of the lighting system 15, as well as the presence of light. 
Additionally, the computer 13 can also control polarizing means, such as the 
angle of polarization. It is appreciated that specimen lighting conditions and 
wavelengths are any of those conventional to the art that yield information 
about crystallization. Specimen illumination is either monochromatic or 
polychromatic, and varies between infrared and x-ray wavelengths. 
Additionally, specimen illumination is by direct lighting, reflective lighting or 
backlighting. In a preferred embodiment, lighting parameter control is by way 
of a control unit that automatically provides illumination having preselected 
characteristics. More preferably, the control unit has a sensor 19 affording 
feedback modulation of actual lighting characteristics relative to preselected 
characteristics. 

In a preferred embodiment a manufacturing execution system such as a 
computer 13 running CrystalScore™ imaging software 11 is in communication 
with the predictive crystallization network computer 17 running a predictive 
neural network analysis 21 so that training experience is fed back into the 
choice of input variables. 
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An experimental sample variable information and crystallization results 
communicated by the imaging software +1 for neural network analysis 17 
results in a trained network capable of predicting crystallization experimental 
conditions. The neural "best fit" learning conditions 19 are communicated to 
from the neural network computer 17 back to the manufacturing execution 
system 13 in order to update experimental design for optimal crystallization. 
Training results of the analysis 21 are also preferably stored in a learning 
database 22 and an experimental database 23. The learning database is 
operative in studying and improving neural network analysis algorithms. 
Similarly, the experimental database 23 is operative in storing for subsequent 
analysis information relevant to the particular protein such as variable related 
parameters. 

In a preferred embodiment, optimal crystallization conditions 19 are 
transmitted via Internet or other conventional networking mode to a server 24 
housing a shared database 27 of protein relevant data. Additional actual 
successful crystallization data is communicated to the server 24. The shared 
database 27 includes information illustratively including protein expression 
gene; protein characteristics; protein class hierarchy; actual protein chemical 
structure including primary, secondary, tertiary and where applicable 
quaternary structures; protein crystal generation recipe parameters; and optimal 
crystallization screen design. The ability to access the shared database 27 
affords a user an opportunity to draw on related protein information relative to 
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a protein of interest in order to expedite experiment design and optimal 
crystallization. 

The present invention utilizes every outcome, including failures, to 
create a crystallization function that describes the various states of 
5 crystallization for the protein in terms of real, physical variables. This software 
then feeds the crystallization function every possible combination in the 
complete user-defined factorial experiment. Some user selected number, for 
example, the top 20 highest predicted crystallization outcomes from all the 
possible permutations. Preferably, the highest outcome conditions are then 

10 automatically created and used for generating optimization recipes that are 
anticipated to promote high-quality crystal growth. The resulting crystals are 
suitable for a variety of uses including x-ray diffraction. 

Preferably, an inventive crystallization process uses as a predictive 
crystallization functions neural network an algorithm capable of predicting 

15 likely successful crystallization outcomes, based on an incomplete yet 
representative sampling of the permutation space. Operative algorithms 
illustratively include Chernov algorithms, Bayesian nets, Bayesian 
Classification, Bayesian Decomposition, and cluster analysis. The 
decomposition analysis includes all data, failures and successes, over time and 

20 return families or clusters of like responses. Moloshok, T.D., Klevecz, R.R., 
Grant, J.D., Manion, F.J., Speier, W.F., and Ochs, M.F. 2002. Application of 
Bayesian Decomposition for analyzing microarray data. Bioinformatics, 
18(4):566-575. An operative inventive neural network looks for patterns in 
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training sets of data, learns these patterns, and develops the ability to correctly 
classify new patterns or makes forecasts and predictions. The operative 
algorithms create a set of basis multiplying functions for each input variable. 
The operative algorithm such as a neural network, a Chernov algorithm, a 
5 Bayesian type algorithm, a Mahalanobis distance, or a Gram-Schmidt 
algorithm, is trained with the initial incomplete factorial screen. The 
user-defined variables of the incomplete factorial become the independent 
training variables. The outcome or score becomes the dependent variable. 
Once trained, both functions are used to predict the highest outcomes for 

10 crystallization from the entire factorial space even though only about 0.1% of 
the factorial space is initially tested. Typically, less than 5% of the factorial 
space is tested; often less than 1% is tested, and in many instances, less than 
0.1% is tested. The quality of testing required is appreciated to be a function of 
variables illustratively including input variable correlation with crystallization 

15 and input variable interdependency. 

According to the present invention, initial crystallization parameter 
design is performed by a user with inputs as to various variables and ranges 
therefor. The imaging software 4-4- accounts for the number of variables V and 
the number of index values each variable V can assume, as shown for a 

20 representative scenario in Table 4- 2. The imaging software 4r4r then performs 
experimental samplings based on a user specified protocol as described herein. 
The software 4-4- drives a variety of commercially available system hardware 
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components illustratively including a dispenser 3 or 5, a tray plate 4, a robotic 
handler 9, an imaging system 6, and a lighting system 15. 

After the neural network training portion of the experimental samples is 
completed, a user interface through a computer provides visualization of each 
5 sample experiment, if desired, and an optional tabular report summarizing 
variable indices, scoring and drop description. The report data from the 
visualization with or without user modification is processed through an 
inventive neural network analysis 17. The analysis 17 in addition to yielding 
optimal variable conditions for crystallization also feeds results to the shared 

10 database 27 in order to serve at least one function from among: creation of 
protein classes based on neural network analysis; identification of common 
physical properties of proteins within a crystallization class; comparison of 
known physical properties of new unscreened targets to those in at least one 
crystallization class and automatic creation of targeted optimization screens 

15 developed for individual crystallization classes so as to bypass initial broad 
experimental samples; prediction of crystallization variables for every 
permutation and the correlation of predictions between various proteins, with 
correlations used to assemble crystallization classes; determination of protein 
classification through the usage of neural network basis functions, Chernov 

20 multiplying functions or other inventive functions; and the creation of a 
distance measurement such as a Mahalanobis distance indicative of input 
variable and outcome between proteins. 
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Spatial correlation template matching between the responses of 
different proteins to the same screen on an experimental sample by 
experimental sample basis provides a spatial distance relationship score. The 
correlation yields a distance score between two proteins. As a measure of how 
well a protein correlates to a second protein crystallization score, a distance 
function can be used between the two proteins. The index i represents each 
experimental sample, so for example 360 different conditions, so I = 1 to 360. 
The distance function compares the response of the protein to each screen 
condition. If the response is identical, the resultant spatial value becomes 1. If 
the response is different, the resultant spatial value becomes 0. The correlation 
between the two proteins then becomes the sum of the resultant spatial values. 
Alternatively, real multiplication can be assigned for comparisons, i.e. if 
Protein 1 responds with large crystals to experimental sample 241 and Protein 
2 responds with small crystals to experimental sample 241, the resultant spatial 
value could become much higher than 1. If a crystal is scored as 1000, then the 
resultant score of crystals at the same condition in two proteins becomes 
1000 x 1000 = 1,000,000. The classification system is organized by comparing 
every protein on a one-by-one basis to other proteins. Neighborhoods and 
families are then organized by relative closeness. 

Measurements are collected, indicating, for example numbers of 
particles, size of particles, straight edges, image color, Fourier analysis metrics 
from each image. These measurements form a vector. The vectors can then be 
clustered using a variety of analyses. Analyses detailed herein such as neural 
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nets, Chernov algorithms, or a Bayesian classification schema operate to 
cluster the vectors. Results from crystallization experiments tend to have 
common characteristics that the analysis identifies. Those metrics or 
measurements that contain useful information differ depending upon the 
resolution of the images collected but the analysis or image classification 
algorithm still operates in a similar manner. 

An inventive predictive neural network is trained, by back propagation, 
using a test set to identify or recognize important features, as shown in Figure 
2. Training an inventive neural network begins by finding linear relationships 
between the network inputs 50 and the output 70. Weight values are assigned 
to the links between the input and output neurons. After those relationships are 
found, neurons are added to the hidden layer 60 so that nonlinear relationships 
can be found. Input values 50 in the first layer 55 are multiplied by the weights 
and passed to the hidden layer 60. Neurons 65 in the hidden layer 60 produce 
outputs that are based upon the sum of weighted values passed to these neurons 
65. The hidden layer 60 passes values 68 to the output layer 70 in the same 
fashion, and the output layer 70 produces the desired predictions. The network 
"learns" by adjusting the interconnection weights between layers. The answers 
the network is producing are repeatedly compared with the correct answers, 
and each time the connecting weights are adjusted slightly in the direction of 
the correct answers. Preferably, additional hidden neurons are added to capture 
features in the data set. Eventually, if the problem is learnable a stable set of 
weights evolves and produces good answers for all of the sample decisions or 
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predictions. The real power of an inventive neural network is evident when the 
trained network is able to produce good results for data that the network has 
never evaluated to predict the conditions that produce crystals from the entire 
experimental factorial space. (Ward Systems Group "Neuroshell Predictor." 
5 2000. www.wardsystems.com). 

The Chernov algorithm is structured similarly to a regression model, 
but instead of coefficients, the algorithm uses mathematical basis functions that 
can be linear or non-linear, discrete or continuous. The mathematical basis 
functions take into account higher-order interactions between the various 

10 components, so variables within a multiplying basis function may contain 
variables from other input functions. The mathematical functions are 
automatically varied in an organized procedure until the r squared value, or 
coefficient of determination, which is basically a measure of the difference 
between observed and computed values, is within an acceptable range. 

15 Typically, the accepted range is usually greater than 0.95. Once trained, the 
Chernov algorithm mathematically describes the various states of 
crystallization (output) in terms of real, physical variable inputs, as shown in 
Equation 1. 

F, V + F 2 *V 2 + F 3 *V 3 + . . . F n * V n = Output (Eqn. 1) 

20 where F n are mathematical basis functions that can be linear or non-linear, 
discrete or continuous, V n are input variables, and Output is the predicted 
score. 
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A Chernov sampling algorithm operative herein for initial experimental 
sample analysis operates as follows. For example, if a variable assumes three 
values and 300 experiments are sampled, then each value is taken, on the 
average, 100 times. If the actual frequencies of those values are 299,300,301, 
then the deviation from the mean are -1, 0, 1, the sum of squares is 
1+0+1=2, hence the root mean square is sqrt(2/3), after accounting for three 
possible values. For a parameter space with several variables that take several 
possible values each, then the inventive algorithm finds the overall root mean 
square for all actual frequencies. This quantity characterizes the uniformity of 
the distributions of individual variables. Ideally, the overall root mean square 
should be zero, but small values of typically less than or about one are also 
operative. 

Similarly, the screening algorithm finds the root mean square deviation 
for pairs of variables. For example, if two variables each assume three values 
and five values, respectively, and 300 experiments are sampled, then each pair 
of values is taken, on the average, twenty times. Now, let the actual 
frequencies be, say, 20, 21, 22, 20, 17, 20. Then the deviations from the mean 
are 0, 1, 2, 0, -3, 0, and the sum of squares is 1 + 4 + 9 = 14. The root mean 
square is sqrt(14/15). For a parameter space with several variables that take 
several possible values each, then the inventive algorithm finds the overall root 
mean square for all actual frequencies for all pairs of variables. This quantity 
characterizes the uniformity of the joint distributions of pairs of variables. 
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Ideally, the overall root mean square should be zero, but small values of 
typically less than or about one are also operative. 

A similar analysis is performed for treble variables. It is appreciated 
that this analysis is readily extended through n-dimensional variables. 
5 For the present example there are three quantities: SI, S2, S3, which are 

root mean square deviations for 1 -variable distributions, 2- variable 
distributions, and 3-variable distributions, respectively. 
A combined quantity S is defined as: 

S = wl*Sl + w2*S2 + w3*S3 
10 where wl, w2, w3 are weights that are either set by the user, fixed, or 
calculated based on external crystallization factors. 

In implementation a computer program constructs the prescribed 
number of samples "in one sweep", without further reconstruction or 
modification of experimental data. This is in contrast to numerous 
15 conventional algorithms that select some experiments randomly or by a quick 
simple procedure, and then modify the experiments in order to improve their 
distribution. The inventive algorithm constructs samples sequentially, in one 
run, and preferably does not change the initial choice. The near uniformity of 
the distribution is achieved by a careful organization of the algorithm. 

20 Table [[ ]] I compares the results from the above algorithm with 

those generated by human choice. 
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Table [[ ]] 1. Comparison of Algorithm and Human Choice Results 



Experiment 


Actual (DSI) 


Present Invention 


SI 


S2 


S3 


SI 


S2 


S3 


Test A 

(9 variables, 900 experiments) 


0.00 


6.94 


4.73 


0.00 


0.84 


1.97 


TestB 

(10 variables, 360 experiments) 


0.00 


3.34 


2.19 


0.00 


0.92 


1.43 


TestC 

(11 variables, 288 experiments) 


4.64 


2.05 


0.69 


0.39 


0.61 


0.42 


TestD 

(10 variables, 1032 experiments) 


34.93 


16.87 


8.06 


0.00 


0.89 


2.11 



The inventive program generated algorithms more uniformly distributed 
experiment samples than those selected by a skilled operator. 

In addition to the protein crystallization screen variables depicted in 
Figure 1, other variables are readily tested as to effect on crystallization. These 
additional variables illustratively include light, magnetism, gravity, atmosphere 
identity, atmospheric pressure, and second virial coefficients. For example, 
with respect to gravity, it can be used as a design variable in the incomplete 
factorial design and subsequent optimization in much the same way as any 
variable such as pH or temperature. By setting the incomplete factorial to 
include two possible values of gravity, an inventive function calculates and 
creates screen experiments for earth and space gravity values. After the initial 
experiments are performed, the present invention analyzes all the results, 
predicts the combination of variables that yield the optimal crystallization 
parameter outputs, and creates the optimizations screens. These optimization 
experiments require the use of gravity in situations where gravity is a major 
factor to the protein crystallization sample. 
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The invention is further detailed with respect to the following 
non-limiting examples. These examples are not intended to limit the scope of 
the appended claims to the illustrative materials and conditions detailed herein. 

Example 1 

Crystallization recipes were developed using 10 variables and 47 
components, as shown in Table i 2 and have 328,050 combinations of 
components. 

The screening results for modeling protein crystallization from a single 
protein were collected and subjected to three types of analysis. The screening 
results from lactoglobulin and protein 9c9 were selected as test cases for 
analysis. Lactoglobulin gave a frequency of forming crystals of 3.1 - 5.8 % 
depending on the screen used. The three types of crystallization analyses used 
for lactoglobulin are: (1) a conventional multiple step regression analysis, (2) 
an inventive neural net analysis and (3) Chernov analysis. The multiple step 
regression analysis uses linear, quadratic and cross products were used to build 
a model based on the screening results. (Carter Jr., C.W., and Carter, C.W. 
Protein crystallization using incomplete factorial experiments. J. Biol. Chem. 
1979, 254:12219-12223; Carter Jr., C.W. Response surface methods for 
optimizing and improving reproducibility of crystal growth. Methods in 
Enzymology 1997, 276: 74-99). 



24 



3 

I 

05 



§ 



o 



© 
G 

P 
s 



I 

E-i 

s 

2 

> 

c4l 



p2 
H 



CN 
CN 

cn S 

o *2 

CN oo 

2 <§P 

Q co 



C 

© 

a 

tin 

3 

•MM 

03 

> 



2 

2 
o. 
S 

H 



CM 



oo 



en 



c 

c 

a © 

2 



CO 



CN 



CO 



CO 



03 



CN 



CN 



CO 



CO 



© 

3 

e 

w 
u 

Cu 

00 
0) 

3 

.2 



CM 

O 



CN 



'Si 



c 



CO 



CN 



CO 



CN 



t-H 



s 

u 

to 

3 

.2 

> 



CN 



CN 



CN 



CO 



DSI-10202/22 
30919gs/am 

The scoring system emphasized crystals and deemphasized non-crystals. The 
test protein used was lactoglobulin (10 mg / ml, 100 mM Tris-HCl, pH 6.5). 
These recipes were mixed with the protein sample using a derivative of the 
batch method. The experiments were monitored over time and the results 
5 scored using CrystalScore™. 

The conventional multiple step regression yields an R 2 vatae value of 
0.54, indicating the failure of this analysis to converge on the correct solution 
and highlighting the inapplicability of this model of protein crystallization 
where the four variables used were protein concentration, pH, temperature, and 
10 precipitant concentration. No further comparison was made with this analysis 
for 9c9 protein. 

In contrast to the multiple step regression, the inventive neural network 
and Chernov analyses rely less on the quality of variables chosen and allow 
convergence to a self-consistent solution. Both neural network and Chernov 
15 analyses are useful to construct a model that will recognize combinations of 
reagents what will most likely give a selected score indicative of optimal 
crystallization. 

It is appreciated that the mathematics of the trained neural network are 
operative to construct a hierarchy ordering classification system that groups 
20 related neural network crystallization models of different proteins based on 
nodal basis functions, nodal construction similarities, contribution of 
importance of input variables or the like. Such a classification system allows 
an uncrystallized protein to be placed into a crystallization group based on its 
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known physical properties. Several techniques exist for placing an unknown 
protein into the correct crystallization group including the use of a separate 
neural network designed to optimize the fit between the unknown protein and 
the existing classification groups. In a preferred embodiment, the classification 
system is self-learning and self-organized by conventional techniques, thus, a 
small number of modeling proteins is sufficient to accurately predict optimal 
crystallization conditions for a large number of unknown proteins. 

The neural network is trained only with lactoglobin experiments 1-315, 
as shown in Figure 3. A representative sampling of the training set is shown in 
Table 3 3. Table 2 3 translates the incomplete factorial design in Table i 2 to 
index values that represent the physical components of the crystallization 
recipe. 
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Experiments 316 to 360 are held out of the training and are used for 
output verification. The 315 experiments allowed the neural network to 
converge with an R 2 value of 0.754, an acceptable value, but still not optimal. 
The scoring system is listed in Table 3- 4. A graphical representation of the 
neural network is shown in Figure 2. The input to the neural network is the 
indexed variables and the output is the predicted score. The weights of the 
hidden neurons are determined by back propagation. 



Table 3 4. Scoring System for Lactoglobulin 



Score 


Descriptor 


1000 


Blue Crystals 


1000 


Large 3d crystals 


1000 


Small 3d crystals 


1000 


Plates 


1000 


Needles 


5 


Rosettes / Spherulites 


4 


Microcrystals / Precipitate 


3 


Precipitate 


2 


Phase Separation 


1 


Clear Drop 



Experiments 316-360 had never been evaluated by the inventive neural 
network yet the neural network was able to predict every crystallization 
outcome of the 45 experiments, including the two crystallization outcomes for 
experiments 322 and 340 as shown in Figure 4. Demonstrates that in 
experiments 316-360, the neural network successfully predicted the 2 crystal 
outcomes (experiments 322 and 340). Figure 5 is a photograph illustrating the 
actual physical crystallization outcomes of the two predicted crystallization 
conditions for experiments 322 and 340. 
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The Chernov algorithm converged on the lactoglobulin training set with 
a R 2 value of 0.93. The Chernov algorithm is used in a predictive manner to 
create optimization conditions for lactoglobulin protein crystallization. The 
highest 20 predictions out of the 328,050 permutations were created and are 
shown in Table [[4]] 5. The Chernov analysis was only performed on 
lactoglobulin screen results. The Chernov analysis optionally is used to 
construct a model that will recognize combinations of reagents that will most 
likely give a selected score. Various scoring schemes are the tested, each 
scheme having a hierarchy built in, that is assigning a measure of importance to 
the out come in order to help the analysis programs identify variables important 
for a particular sample crystallization function. This is demonstrated by the 
enhanced scoring system used for the neural network that accurately predicted 
the crystallization conditions of lactoglobulin. 
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A similar methodology to lactoglobulin was used for an unknown 
purified protein, a previously uncrystallized sample. For the unknown purified 
protein, experiments 1-315 were used to train the neural network. There was 
only one crystal condition in the training set (experiment 239), as shown in 
5 Figure 6. The neural network converged with an R 2 value of 0.604. The 
assigned scoring system was binary: No-crystal 0, Crystal 2000. Experiments 
316-360 were used to verify the neural network. The trained neural network 
accurately predicted the only crystal yielding experiment (experiment 350), as 
shown in Figure 7. Figure 8 is a photograph illustrating the actual physical 
10 crystallization outcomes of the predicted crystallization conditions for 
experiment 350. 

Example 2 

A neural network was trained on 90% (259 experiments) of the 
randomized test set for Protein Delta 8-10B. The trained neural network is 

15 applied on the remaining -400,000 conditions not tested and then take the top 
20 predicted scores for optimization. 

An incomplete factorial screen with 1 1 input variables was designed for 
Protein Delta 8-10B. This protein is considered a peripheral membrane protein 
that has undergone attempts of crystallization. It is a therapeutically important 

20 protein whose structural data would be of great interest to the scientific 
community. The incomplete factorial was composed of 288 experimental 
samples. The incomplete factorial screen yielded the following outcomes: 226 
clear drops, 3 phase separation, 39 precipitate, 10 microcrystals/precipitate, 
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8 rosettes/spherulites, 2 needles, 0 plates, 0 small 3d crystals, and 0 large 3d 
crystals. These outcomes were scored using the scoring system of Table & 6. 



Table 5 6. Scoring System for Delta 8-10B 



Score 


Descriptor 


9 


Large 3d crystals 


8 


Small 3d crystals 


7 


Plates 


6 


Needles 


5 


Rosettes / Spherulites 


4 


Microcrystals / Precipitate 


3 


Precipitate 


2 


Phase Separation 


1 


Clear Drop 



A partial set of screen for protein Delta 8-10B is shown in Table 6 7. 
The variables Vl-Vll become the independent inputs while the score becomes 
the dependant output of the neural network. Experiments 1-259 were used to 
train the neural network as shown in Figure 9. Experiments 260-288 were used 
to test the validity of the training as shown in Figure 10. The relative 
importance of input variables is shown in Figure 11 where buffer index and pH 
are the most significant variables. 

Experiments 260-288 are used to verify the neural network. The 
inventive network was able to predict the crystallization condition for the only 
crystal in the test set (Experiment 282) even though it had never been trained 
on the experiment. There were two false positives (Experiment 263 and 275) 
although the relative highest predicted score is for the correctly predicted 
crystal condition. 



33 



pa 

<u o 

a 00 
E 5 

g 2 
a Q 

4> .£ 
^ o 

< $ 



CN 

CN 

CN E 
o ^ 

CN «J 
O 

Q m 



o 
o 
00 



< 



I go 
> G > 



(3 On 



£? c > 

JIT t— — i 



II r- 



1>SP > 

5— i 

o 



£2 



X 

u-4 t3 ^> 



1? G 

.5 o 

<D *X3 CN 

o £ > 



a. 
E r; 

H 



CN 



CN 



CN 



cn 



CN 



cn 



CN 



CO 



CN 



in 



00 

B 

% 

a 

a 

to 

a 

u 

ca 



G 
O 



© 

3 

G 

I 

u 



G 
O 

"E 

e 

© 

001 

3 
H 



-5b 



f>0 

b. 



■a 



PQ 



I 



P 



I 



s :S 



o 

o 
© 



8« 



£1 



8 



DSI-10202/22 
30919gs/am 

A neural network, trained by 90% (259 experiments) of an incomplete 
randomized test factorial screen for Delta 8-1 OB, is able to predict the only 
crystallization condition in the remaining 10% (29 experiments) of the 
incomplete factorial screen. The 90% test set contained only 1 needle 
condition while the test set contained only 1 needle condition. The neural 
network is able to predict the crystallization condition of the needle in the test 
set even though the 2 needles crystallized with very disparate conditions as 
shown in Table 2 8. The neural network trained with all results, including 
failures. The ability of the neural network to identify patterns of crystallization 
in complex non-linear datasets is a powerful method of optimization. 

Example 3 

A neural network was trained on 87.5% (315 experiments) of the 
randomized test set for Catalase. The remaining 12.5% (45 experiments) of the 
test set was used for verification. There were 13 crystals in the verification set. 
The top 15 neural network predictions included 12 of the 13 crystals in the 
verification set. 

An incomplete factorial screen with 13 input variables was designed for 
Catalase. The incomplete factorial was comprised of 360 experimental 
samples. The outcomes were scored using the scoring system shown in Table 
S 9. The incomplete factorial matrix was randomized by sorting on a column 
of randomized numbers in Excel®. The first 315 experiments were used to 
train the neural network as shown in Figure 12. The training converged with 
an R squared value of 0.744 and a correlation of 0.863. The validity of the 
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neural network was then verified by the remaining 45 out-of-sample 
experiments as shown in Figure 13. The out-of-sample experiments had an R 
squared R 2 value of 0.439 and a more meaningful correlation value of 0.675. 
Table 8 9. Scoring System for Catalase. 



Score 


Descriptor 


90 


Large 3d crystals 


80 


Small 3d crystals 


70 


Plates 


60 


Needles 


5 


Rosettes / Spherulites 


4 


Microcrystals / Precipitate 


3 


Precipitate 


2 


Phase Separation 


1 


Clear Drop 



The top 15 neural network predictions included 12 of the 13 crystals in 
the verification set shown in Figure 13. The 3 false positives included 2 
precipitate conditions and 1 clear drop condition. The false negative (13 th 
crystal) occurred at the 23 rd highest predicted score. The relative "importance 
of inputs" is shown in Figure 14. InS, anionic concentration, % Organic, and 
Glycerol %, are the respective most important variables for crystallization of 
Catalase. 

Publications cited herein are indicative of the level of skill in the art to 
which the invention pertains. Each publication is hereby incorporated by 
reference to the same extent as if each publication was individually and 
explicitly incorporated herein by reference. 

The foregoing description is illustrative of particular embodiments of 
the invention, but is not meant to be a limitation upon the practice thereof. The 
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following claims, including equivalents thereof are intended to define the scope 
of the invention. 
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